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@ Error concealment apparatus for video signal processors. 



@ Error concealment apparatus for correcting 
enrors In signals representing video images in- 
cludes means (31,22,32) for detecting image 
gradients in an area sunrounding a lost block of 
Image data. Circuitry (34) responsive to these 
image gradients generates a plurality of blocl<s 
of directlonally interpolated pixel values. The 
pixel values In the respective blocks of dlreo- 
tionally interpolated pixel values are sorted ac- 
cording to amplitude, and then pixel values 
from mutually exclusive positions in the respec- 
tive blocks are selected (36) to form a block of 
pixel values for enror concealment. 
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This invention relates to error concealment appa- 
ratus for replacing daniaged or lost two dimensional 
blocl<s of pixel values in reproduced images. 

In video signal transmission systems of the type 
which compress video data on a block basis as for ex- 5 
ample systems which utilize discrete cosine trans- 
forms, data loss and/or data damage frequently oc- 
curs on a block basis (e.g. a 16 X 16 array of pixels). 
These transmission systems normally do not support 
enough excess capacity to correct all errors, but rath- io 
er depend on error concealment techniques to pro- 
vide substitute data which closely approximates the 
tost data. Werner Keesen et. al. in United States Pa- 
tent No. 4,807,033 issued 21 February 1 989, disclose 
an error concealment system for replacing two di- is 
mensionat blocks of image data. This system includes 
apparatus for detecting blocks of lost data and replac- 
ing the lost image data in the spatial domain with pixel 
values generated from surrounding pixels by interpo- 
lation. The surrounding pixels are examined to deter- 20 
mine the existence of image edges (gradients) and 
thereafter interpolation is performed to generate a 
block of pixel values to replace the lost or damaged 
block of pixel values. 

Directional interpolation, as used herein, is the 25 
process of generating pixel values by performing one 
dimensional interpolation along a particular direction. 
Refer to FIGURE 1 where the respective blocks rep- 
resent respective image areas forming the basis of 
block based compression. The dots within the respec- 30 
tive blocks represent pixel values, in this instance rep- 
resenting white or black image points. The center 
block which is void of dots represents a damaged 
block for which substitute pixels are to be generated. 
If for example, pairs of pixels within the two rows of 35 
pixels circumscribing the central block are appro- 
priately examined, existing image gradients may be 
determined as for example the diagonal white line. 
Then based on the gradient information interpolation 
is performed in the direction of the strongestdetected 40 
gradients. In the Figure, the pixels which fall on a giv- 
en arrow are generated from pixels in the adjacent 
blocks and occurring along extensions of the respec- 
tive arrows. 

The Keesen et.al apparatus detects image gra- 45 
dient information and for single gradients performs 

one directional interpolation. If more than one strong 
gradient is detected, a directional interpolation is per- 
formed for each of the strong gradients and the arith- 
metic sum of the respective directionally interpolated 50 
blocks of pixels is utilized as the substitute block. 

Summing the respective interpolated blocks of 
pixels gives respective pixel values equal weight and 
tends to blur image features. Consider a gray image 
containing a horizontal white line behind a vertical 55 
black line. Vertical interpolation will generate a block 
of gray pixels including the vertical black tine. Hori- 
zontal interpolation wilt generate a block of gray pix- 



els including the horizontal white line The arithmetic 
average of these Interpolated blocks will be a block of 
gray pixels including a lighter than black vertical line 
and a darker than white horizontal line, with a gray 
area at the Intersection of the lines. 

The present invention is an improvement over the 
Keesen et.al error concealment apparatus and in- 
cludes means for detecting image gradients and 
means responsive to these image gradients for gen- 
erating blocks of directionally interpolated pixel val- 
ues. The pixel values in the respective blocks of direc- 
tionally interpolated pixel values are sorted according 
to amplitude, and then pixel values from mutually ex- 
clusive positions in the respective blocks are selected 
to form a block of pixel values for error concealment. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIGURE 1 is a pictorial representation of a por- 
tion of the blocks of pixel values representing an Im- 
age, which representation is useful in describing the 
invention. 

FIGURE 2 is a block diagram of apparatus for de- 
compressing video signal and including block based 
error concealment apparatus embodying the present 
Invention. 

FIGURE 3 is a block diagram of exemplary error 
concealment apparatus which may be employed for 
element 26 of FIGURE 2. 

FIGURE 4 is a pictorial representation of the con- 
cealment apparatus of FIGURE 3. 

FIGURE 5 is a Table showing an exemplary cri- 
terion of selecting pixels to form a substitute block of 
pixels when a plurality of directionally Interpolated 
blocks of pixels are generated with respect to a single 
block location. 

FIGURE 6 is a block diagram of a second embodi- 
ment of a directional error concealment apparatus. 

FIGURE 7 is a flow chart showing the operation 
of the combining element 36 of FIGURE 3. 

In order to perform block based error conceal- 
ment it is necessary to be able to determine lost or 
damaged blocks of signal. To this end It is assumed 
that the transmitted signal to be processed in the ex- 
emplary embodi ments is formatted in transport pack- 
ets. Each packet includes a header, a payload, and 
error check bytes. The header includes sufficient in- 
formation to identify the spatial locations, in the re- 
produced image, of the respective blocks of com- 
pressed video data carried in the payload. The error 
check bytes are of a form to allow error detection of 
substantially all potential errors and at least partial 
error correction. An example of this type of signal for- 
mat may be found in United states Patent No. 
5,247,363, issued 21 September 1993. 

Refer to FIGURE 2 which illustrates a general 
form of a receiver for processing the above described 
signals. Transmitted signals, from for example, an an- 
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tenna (not shown) are applied to a tuner/demodulator 
10, which provides baseband signal. The baseband 
signal is applied to a forward error correction, FEC, 
decoder 12, which examines the transmitted signal 
and corrects errors Incurred in the transmission s 
channel, according to its error correction capability. 
Error corrected data from the FEC decoder 12 is ap- 
plied to a rate buffer 14 which accepts data at a rela- 
t Ively constant rate from the FEC decoder 1 2 and out- 
puts data on demand to the subsequent processing io 
elements. Data from the buffer is coupled to a frame 
check sequence, FCS, decoder 16, which examines 
the error corrected data for uncorrected errors ac- 
cording to FCS check bits appended to the transport 
packets. 15 

The FCS decoder 16 passes transport packets, 
D, to element 18 along with an error signal, ED, indi- 
cating whether respective transport packets contain 
data errors. Element 18, responsive to the error data, 
discards transport packets which include data errors. 20 
Error free transport packets are separated into video 
data and transport header data. The transport header 
data and error data, ED, are utilized to determine 
what data is lost, and thereafter to generate and sub- 
stitute synthetic compressed video data for the lost 25 
data. An example of apparatus for creating synthetic 
compressed video data may be found in U.S. Patent 
application Sn. 07/789.245. filed November 7, 1991, 
and entitled "APPARATUS FOR CONCEALING ER- 
RORS IN A DIGITAL VIDEO PROCESSING SYS- 30 
TEM". Element 18 passes the combined error free 
video data and synthetic data to a decompressor 20. 
In addition element 18 passes error tokens to the de- 
compressor 20, which tokens may provide several 
functions. For example, it may occur that for the type 35 
of data that was lost in a particular transport packet, 
a better image may be reproduced if decoding that 
portion of the data is simply skipped by the decom- 
pressor 20 rather than generating synthetic conrv 
pressed video data for application to the decompres- 40 
sor. in this instance the error token is established to 
affect the sequence of operation of the decompres- 
sor. Alternatively, it may occur that it is known a priori, 
that synthetic compressed data for particular blocks 
Is unlikely to produce acceptable images, and that al- 45 
taring the decoding sequence of the decompressor 
will not improve over utilizing synthetic compressed 
data. In this instance particular error tokens are 
passed to a further error concealment processor 26 
which operates on decoded or decompressed video 50 
signal. 

The decompressor 20 utilizes frames of memory 
22 in the decompression process. This memory is ar- 
ranged to store frames of decoded video signal for 
use in the process of motion compensated predictive 55 
decoding. Decoded image information is subse- 
quently transferred to a display memory 24 from 
which it may be accessed in raster format for display. 



The error concealment element 26 interacts with 
the decompressed data In memory 22, and substi- 
tutes image data identified by the error tokens. Lu- 
minance and chrominance data are decompressed 
separately but by similar processes and then recom- 
btned for display. The following discussion regarding 
error concealment is directed to concealment of er- 
rors in the luminance data. Errors in chrominance 
data are concealed in similar feshion by similar par- 
allel apparatus not shown. 

FIGURE 3 shows schematically and FIGURE 4 
shows pictorially the functions of one embodiment of 
the error concealment apparatus 26 of FIGURE 2. 
Nominally these functions will be programmed into 
the software of a special purpose microprocessor 
though they may be provided by individual circuit ele- 
ments as indicated. In FIGURE 3 the ERROR DATA 
is provided to a controller 31 which, responsive there- 
to, marshalls the necessary pixel data through the re- 
spect ive circuit elements. In response to an indication 
of a lost block of pixel data the controller 31 accesses 
pixel values from the memory 22. The pixel data ac- 
cessed are pixel values from blocks of pixels spatially 
adjacent to the lost or damaged block. For example 
three or four rows of pixels circumscribing the lost 
block may be accessed and provided to the working 
memory 30. The pixel data is then provided to a direc- 
tion classifier 32. The direction classifier determines 
significant Image gradients represented by the pixels 
surrounding the lost block, and then selects the top 
one, two or three gradient directions that tend to iden- 
tify the predominant local image contours (or most 
strongly characterize image edge orientations). 

Classification Is performed through the use of 
gradient measures in the spatial domain. The local 
edge gradients gx, and gy for a respective pixel loca- 
tion x(i,j), are computed from: 

9x = X| . ij + 1 - X| . 1 J . 1 + X|j + 1 - X|j . 1 + 

X1 + IJ + I - Xi + ij. 1 (1) 
9y = X| + 1 J . 1 - Xj . ij . 1 + X| ♦ t J - X| . ij + 

X| + ij + 1 - X| . 1 J + 1 (2) 
This is equivalent to applying the following 3X3 Pre- 
witt convolutional mask operators: 

[-1 0 1] pi -1 -r 
-101 fly= 0 0 0 

-1 0 ij [1 ^ 1^ 

The magnitude, G, and angular direction, <I>, of the 
gradient a t (i,j) are g iven by: 

G = Vgx^ + 9/ <S> = tan-i(gy/gx) (3) 
These gradient measures are computed for each (l,j) 
coordinate in the neighborhood surrounding the 
missing or damaged block. The value of the respec- 
tive gradient angles are rounded to the nearest 22.5 
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degrees, for example, and thus corresponds to one of 
eight directional categories D1 - D8. If a line drawn 
through a respective (ij) neighborhood pixel coordin- 
ate with the direction determined by the gradient an- 
gle will pass through the missing block, that particular 5 
(i,j) pixel coordinate is given a vote. The directional 
categories D1 - 08 of the voting coordinates are mu- 
tually exclusively accumulated by summing the mag- 
nitudes of the associated directional gradients. That 
is, the magnitudes of the voting coordinates having io 
directional category D1 are accumulated to form one 
sum, the magnitudes of the voting coordinates having 
directional category D2 are accumulated to form a 
second sum and so on. The directional categories ex- 
hibiting the largest accumulated sums determine pix- is 
el Interpolation directions. 

The selected directions provided by the classifier 
32 are coupled to a directional interpolator 34. For 
each of the selected directions, the interpolator gen- 
erates a block of spatially interpolated pixel values ac- 20 
cording to a corresponding directional interpolation 
algorithm. For a given direction , a series of one di- 
mensional interpolations are performed using neigh- 
borhood pixel values intersected by a directional line 
cutting through the surrounding neighborhood. De- 25 
pending upon the particular direct ion, not all pixel val- 
ues may be generated bysuchaonedimensional pro- 
cedure. In this instance the missing pixel values are 
generated by Interpolation of the immediately sur- 
rounding interpolated pixel values. The respective in- 30 
terpolated blocks of pixel values are coupled to a com- 
bining circuit 36. 

The combining circuit 36 is designed to extract 
the strongest characteristic features of the two or 
more images represented by the directionally Interpo- 35 
lated blocks of pixel values. For each interpolated 
block, the mean value and the variance of the pbcel 
values is calculated. Pixel values close to the mean 
may be considered to represent background image 
Information and pixel values further from the mean to 40 
represent foreground information. It has been deter- 
mined that a threshold of one standard deviation pro- 
vides good results. 

Pixel values that differ from the mean by more 
than one standard deviation and are greater or lesser 45 
than the mean correspond to bright foreground fea- 
tures, and dark foreground features respectively. To 
extract bright foreground features the maximum pixel 
values for respective coordinates from the different 
ones of the interpolated blocks are selected using a so 
MAX operator. Similarly, to extract dark foreground 
features, a MIN operator is utilized to select the pixel 
values having the smallest values. The MAX (MIN) 
operator is simply the process of selecting the largest 
(smallest) pixel value from corresponding coordin- 55 
ates of the respective blocks designated as bright 
(dark) foreground pixels. The background features of 
the plurality of interpolated blocks of pixels are aver- 



aged. Pixel areas of one block may contain bright 
foreground features and corresponding areas of an- 
other block may contain dark foreground features. In 
these instances the pixels are also averaged. All fore- 
ground/background contention between pbcels repre- 
senting a corresponding coordinate are settled in fa- 
vor of the value representing a foreground feature. 
Figure 5 shows an exemplary matrix of pixel selection 
criteria for a system which combines pixels from two 
blocks of interpolated pixel values, and this matrix is 
easily expanded to encompass pixel value selection 
from three or more interpolated blocks. 

FIGURE 7 is a flow chart of the pixel value selec- 
tion process of the combining circuit 36. This flow 
chart assumes that the system generates, at most, 
two interpolated blocks for each bad block. After the 
respective interpolated blocks of pixel values have 
been generated the circuit 36 is initialized [700]. The 
respective blocks are accessed [702] and the mean 
^{ and the variance a\ of the pixel values V(i,j) are cal- 
culated [703] for the respective interpolated blocks. 
Pairs of pixel values V(i,j)i from corresponding coor- 
dinates of the two interpolated blocks are accessed 
[704], and the pixel values are compared to the sum 
of the respective mean and variance, (^i + ai), [706A, 
706B]. If the respective pixel values are greater than 
their respective (^i + oi), they are considered to rep- 
resent a bright foreground feature. Whether both pix- 
els represent a bright foreground feature is checked 
[707], and if they do the maximum of the two pixel val- 
ues is selected [708] as the pixel value for the respec- 
tive coordinate of the substitute block. The system 
then accesses [704] and examines the next pair of 
pixel values. If they do not both represent bright fore- 
ground features, the pair of pixel values are examined 
[71 OA, 71 OB] to determine if they are respectively 
less than the difference of their respective means 
and variances, (m-ai), and presumed to represent 
dark foreground image features. A check is made 
[711] to determine if they both represent dark fore- 
ground features, and if they do. the minimum (712) of 
the two pixel values V(i,j) is selected to populate the 
corresponding coordinate of the substitute block of 
pixel values and the values for the next coordinate are 
accessed [704]. 

If a pixel values does not satisfy the conditions of 
step [706] and [710] that pixel Is considered to repre- 
sent a background image. If neither of the conditions 
of steps [707], [711], have been satisfied the corre- 
sponding pixel values are examined [714] to deter- 
mine if they both represent a background image. If 
they do, the two pixel values are averaged [717] to 
provide a pixel value for the corresponding coordin- 
ate, and the system then accesses the next pair of 
pixel values, if they are not both background values, 
they are checked [716] to determine if one of them is 
a background pixel. If one is a background pixel, the 
other must be a foreground pixel and the foreground 
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pixel is selected [718]. If one is not a background pixel 
then the two pixel values must represent a bright and 
a dark foreground feature, in this instance the two 
pixel values V(ij) are averaged [717] to generate the 
pixel value for the corresponding coordinate. 5 

One skilled in the art of system design will readily 
recognize that the system described in FIGURE 7 is 
amenable to either a software realization in a micro- 
processor or a combinatorial logic hardware realiza- 
tion. Alogic realization will provide significantly faster io 
results. 

FIGURE 6 illustrates a further embodiment of the 
invention. Elements of the FIGURE 6 apparatus des- 
ignated with the same numbers as elements of the 
FIGURES 2 and 3 apparatus are similar, and perform is 
like functions. In this instance however, a greater por- 
tion of the neighboring pixels in the adjacent blocks 
may be utilized, and as many as ail of the pixels in the 
blocks adjacent the lost block may be utilized. As- 
sume that the center block shown In FIGURE 1 is a 20 
missing block and substitute pixels are to be gener- 
ated for this block. All of the pixels of the adjacent 
blocks B1 - B4, B6-B9 are loaded into the working 
memory 30, and from this data, image gradient data 
D1 - D8 are determined. Asuper block, the size of the 2$ 
nine blocks shown in FIGURE 1, for example, and 
comprising the blocks of pixel data in memory 30 and 
nominal pixel values, for example values represent- 
ing a mid-gray, for the pixel values of the missing 
block is assembled. This super block is applied to a 30 
transform element 40 which performs a spatial to fre- 
quency domain transform. The transform may take 
the form of a discrete cosine transform, or a fast four- 
ler transform for example. The transform element 40 
develops a matrix of coefficients including a DC coef- 35 
ficient representing the average of all of the pixel val- 
ues in the composed superiblock, and a plurality of AC 
coefficients representing the various frequency conrv 
ponents of the spatial image. Respective ones of 
these coefficients represent the vertical, horizontal, 40 
and various diagonal frequency contents of the inv 
age, and these coefficients are easily identifiable. 
The transform coefficients are applied to a filter ordi- 
rectional mask 41 . This filter is responsive to the gra- 
dient data provided by the classifier 32. to passes the 45 
transform coefficients which correspond to the angu- 
lar frequencies represented by the spatial gradients 
and sets the remainder of the coefficients to zero val- 
ue. The filter includes a plurality of mask operators 
each of which is arranged to provide a matrix of trans- so 
form coefficients corresponding to data representing 
particular directional Image data, with other coeffi- 
cient positions in the matrix set to zero value. In other 
words the respective mask operators mask those 
coefficients which do not contribute spatial informa- ss 
tion corresponding to a selected spatial gradient an- 
gle. Selection of the mask operators D1-D8 Is control- 
led by the classifier 32. 



The directionally filtered matrices of transform 
coefficients are applied to a combining circuit 42, 
wherein the coefficients of the respective matrices 
are non additively combined to form a further matrix. 
Assume that the transform element 40 generates an 
NxN matrix of coefficients. Each of the directional 
matrices will also be an NxN matrix of coefficients, 
with coefficients at particular (i,j) matrix locations ze- 
roed, and the remaining coefficients equal in value to 
the coefficients at corresponding locations in original 
matrix. More than one of the directional matrices ap- 
plied to the combiner may have coefficients at corre- 
sponding matrix locations, which coefficients will 
have equal values. The combiner accesses the coef- 
ficients from the selected directional matrices, and 
fills in the further matrix with the respective coeffi- 
cient values found In all of the selected directional ma- 
trices. 

The matrix of coefficients formed by the combin- 
er 42 are applied to an inverse transform element 43 
which transforms the frequency domain coefficient 
data to spatial domain data. The data provided by the 
inverse transform element 43 will consist of a super 
block of pixel data, which super block is the same size 
as the original or starting spatial super block. At this 
point, the pixel values generated by the inverse trans- 
form and corresponding to the missing block of pixels 
may be substituted for the missing block of pixel val- 
ues in memory 22. Alternatively a more accurate es- 
timate of the pixel values for the missing block may 
be obtained by Iterating the preceding process. That 
is successive super blocks are formed and processed 
using data generated in the preceding iteration. In 
each Iteration the missing block of the super block Is 
provided with pixel values generated for the missing 
block in the previous iteration. Note that for succes- 
sive Iterations, the same gradient data is used for 
coefficient masking. It has been found that relatively 
good results are obtained with two iterations. 

It was Indicated above that the Inverse transform 
element 43 generated a superblock of pixel values the 
same size as the original superblock. From transform 
data representing a particular size matrix of pixel val- 
ues it is possible by inverse transform techniques to 
produce a lesser sized matrix of pixel values, and the 
inverse transform element 43 may be so arranged. 
That is from the coefficients representing the super- 
block, the inverse transform element 43 may be ar- 
ranged to generate a block of pixel values the size of 
the missing block. 

The size of the super block used in the preceding 
example was exemplary only. For missing blocks of 
e.g. 8X8 pixels, super blocks of 16 X 16 pixel values 
may be utilized, or super blocks of any convenient si- 
zes. 
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Claims 

1. Apparatus for concealing blocks of erroneous 
pixel data characterized by: 

a source (20,22) of pixel data representing 
respective images and a source of error data in- 
dicating blocks of said pixel data that nnay be lost 
or corrupted (hereinafter designated bad pixel 
data); 

means (31) responsive to said error data, 
for accessing (30) from said source (22), pixel 
data located adjacent to a block of bad pixel data, 
and generating (32) directional indicators Di 
which indicate respective angular directions of a 
predetermined number of predominant image 
features in the area local to the block of bad pixel 
data; 

means (34) responsive to said indicators 
Di for generating respective blocks of I mage data 
substantially representing unidirectional image 
features, from pixel data located adjacent to said 
block of bad data; and 

means (36) for selectively non additively 
combining, at least in part, image data from cor- 
responding coordinates of said respective blocks 
to form a further block representing, at least in 
part, pixel data corresponding spatially to said 
block of bad pixel data. 

2. The apparatus set forth in claim 1 characterized 
in that said means for generating respective 
blocks of image data includes means for provid- 
ing interpolated blocks of pixel data, each interpo- 
lated block of pixel data being generated by per- 
forming one dimensional interpolations along 
one specific direction indicated by an indicator 
Di, using pixel data adjacent said block of bad pix- 
el data. 

3. The apparatus set forth in daim 2 characterized 
in that said means for selectively combining in- 
cludes means for differentiating interpolated pix- 
el data between foreground and background inri- 
age features, and wherein interpolated pixel data 
from corresponding coordinates from said inter- 
polated blocks are selected according to a prede- 
termined hierarchy to fill in a corresponding co- 
ordinate in said further block. 

4. The apparatus set forth in claim 2 characterized 
in that said means for selectively combining in- 
cludes means for differentiating between fore- 
ground and background pixel data; for differen- 
tiating between bright and dark foreground pixel 
data; and for selecting pixel data representing the 
brightest (darkest) foreground feature from cor- 
responding coordinates of said interpolated 
blocks containing bright (dark) foreground pixel 



data to fill in a corresponding coordinate of said 
further block. 

5. The apparatus set forth In claim 1 characterized 
5 in that said means responsive to said indicators 

Di for generating respective blocks of image data 
includes: 

meansfor performing a spatial to frequen- 
cy transform on a block of said pixel data adja- 

10 cent said bad block, to generate a matrix (block) 
of transform coefficients, wherein respective 
transform coefficients represent different direc- 
tional image information; 

means, responsive to said indicators Di, 

15 for forming respective intermediate matrices 
(blocks), each intermediate matrix formed by se- 
lection of ones of said transform coefficients 
which represent simitar directionaily oriented im- 
age information. 

20 

6. The apparatus set forth in claim 5 characterized 
in that said means for selectively non additively 
combining, includes means for populating a ma- 
trix with coefficients contained in said intermedi- 

25 ate matrices, and means for performing an in- 
verse transform on the matrix of combined coef- 
ficients to generate a block of pixel values, ones 
of which correspond spatially to said block of bad 
pixel data. 

30 

7. Apparatus for concealing blocks of erroneous 
pixel data characterized by: 

a source (20,22) of pixel data representing 
respective Images and a source of error data in- 
35 dicating blocks of said pixel data that may be lost 
or corrupted (hereinafter designated bad pixel 
data); 

means (31) responsive to said error data, 
for accessing (30) pixel data located adjacent to 

40 a block of bad pixel data, and generating (32) di- 
rectional indicators Di which indicate respective 
angular directions of a predetermined number of 
predominant image features in the area local to 
the block of bad pixel data; 

45 means (34) responsive to said indicators 

Di for providing interpolated blocks of pixel data, 
respective interpolated blocks of pixel data being 
generated by performing directional interpola- 
tions along specific spatial directions indicated 

50 by an indicator Di, using pixel data adjacent said 
block of bad pixel data; and 

means (36) for selectively non additively 
combining, at least in part, image data from cor- 
responding coordinates of said respective blocks 

55 to form a further block representing pixel data 
corresponding spatially to said block of bad pixel 
data. 
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8. The apparatus set forth in claim 7 characterized 
in that said means for selectively combining in- 
cludes means for differentiating between fore- 
ground and background pixel data and for differ- 
entiating between bright and dark foreground 5 
pixel data, and for selecting pixel data represent- 
ing the brightest (darkest) foreground feature 
from corresponding coordinates of said interpo- 
lated blocks containing bright (dark) foreground 
pixel data to fill in a corresponding coordinate of io 
said further block. 

9. The apparatus set forth in claim 8 characterized 
in that said means for generating directional indi- 
cators Di, generates indicators restricted to a set 15 
of predetermined angular directions. 

10. The apparatus set forth in daim 8 characterized 
in that said means for selectively non additively 
combining Includes; 20 

means for determining the mean value of 
pixel data for respective interpolated blocks, and 
selecting pixel data greater and lesser than said 
mean value by a predetermined amount to repre- 
sent foreground features. 25 
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